View Issue Details

IDProjectCategoryView StatusLast Update
0001938T99X171.00 SKB EaglexTS certificationpublic2024-07-05 12:02
Reporter(ALTech) Sangmin Choi Assigned To(ALTech) Sangmin Choi Due Date2024-05-13 18:00
PrioritynormalSeveritys4-minorReproducibilityN/A
Status closedResolutionreopened 
Summary0001938: [Eagle][OS12] ALT Google certification fail item
DescriptionHello, Kinbay,

I will update the fail items for Eagle OS12 here, please check fail items.

Thank you.
TagsNo tags attached.
Attach Tags

Users monitoring this issue

Activities

(ALTech) Sangmin Choi

2024-05-03 10:24

developer   ~0015661

Last edited: 2024-05-07 16:20

#### Test : GTS
#### Module : WvtsDeviceTestCases
#### Test Case : com.google.android.wvts.MediaDrmParameterizedTests#testUsageTableCapacity[L1]

#### run gts -m WvtsDeviceTestCases -t com.google.android.wvts.MediaDrmParameterizedTests#testUsageTableCapacity[L1]

It was passed after factory reset, please skip this item.

(ALTech) Sangmin Choi

2024-05-03 14:19

developer   ~0015675

Hello, Kinbay,

I will upload the fail items here until I get the full passed report, please help each item to pass.

Thank you.
Sangmin Choi.

(ALTech) Sangmin Choi

2024-05-07 08:28

developer   ~0015696

Last edited: 2024-05-08 07:47

#### Test : TVTS
#### Module : TvtsYouTubeTS
#### Test Case : com.google.android.apps.yts.tvts.TvtsYouTubeTS#testYTS

#### run tvts -m TvtsYouTubeTS -t com.google.android.apps.yts.tvts.TvtsYouTubeTS#testYTS

It was passed.
tvts_ TvtsYouTubeTS_log.zip (1,516,133 bytes)

(ALTech) Sangmin Choi

2024-05-07 13:01

developer   ~0015704

Last edited: 2024-05-07 16:20

#### Test : CTS or CTS on GSI
#### Module : CtsNetTestCases
#### Test did not run. No token '[SIM_CARD]' matching it on any device.
#### How can I pass this item?

It was passed, you don't need to check this item.

(ALTech) Sangmin Choi

2024-05-13 11:19

developer   ~0015758

Last edited: 2024-05-14 14:09

#### Test : STS
#### Module : CtsSecurityTestCases

#### run sts-dynamic-full -m CtsSecurityTestCases

It was passed after moved the focus.
For the below case, you can try the UI focus on the bottom button (as attached screenshot)

05-13 12:13:27 I/ModuleListener: [1/100] SKBFX9C72AC android.security.cts.FlagSlipperyTest#testWindowIsNotSlipperyWhenAdded FAILURE: java.lang.AssertionError: Expected ACTION_MOVE, but got a null event instead
    at org.junit.Assert.fail(Assert.java:89)
    at android.security.cts.FlagSlipperyTestKt.assertAction(FlagSlipperyTest.kt:64)
    at android.security.cts.FlagSlipperyTestKt.access$assertAction(FlagSlipperyTest.kt:1)
    at android.security.cts.FlagSlipperyTest$assertBottomWindowDoesNotReceiveSlipperyTouch$1.perform(FlagSlipperyTest.kt:320)
    at android.security.cts.FlagSlipperyTest$assertBottomWindowDoesNotReceiveSlipperyTouch$1.perform(FlagSlipperyTest.kt:316)
    at androidx.test.core.app.ActivityScenario.lambda$onActivity$2$ActivityScenario(ActivityScenario.java:660)
    at androidx.test.core.app.ActivityScenario$$Lambda$4.run(Unknown Source:4)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at android.app.Instrumentation$SyncRunnable.run(Instrumentation.java:2266)
    at android.os.Handler.handleCallback(Handler.java:938)
    at android.os.Handler.dispatchMessage(Handler.java:99)
    at android.os.Looper.loopOnce(Looper.java:201)
    at android.os.Looper.loop(Looper.java:288)
    at android.app.ActivityThread.main(ActivityThread.java:7839)
    at java.lang.reflect.Method.invoke(Native Method)
    at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:548)
    at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1003)

I got following fails under STS CtsSecurityTestCases.
It's weird because I can get pass result last week, but now I couldn't pass it.
Did you get same fail before? or do you have any guide to pass it?

(ALTech) Sangmin Choi

2024-05-13 11:24

developer   ~0015759

This is result and log for CtsSecurityTestCases.
2024.05.13_10.10.40_log.zip (1,992,472 bytes)

(ALTech) Sangmin Choi

2024-05-14 08:53

developer   ~0015775

Hello, Kinbay,

The security patch version of the firmware I'm testing is 2024-03-01.
Can I use the android-sts-12_sts-r25-linux-arm.zip for security patch 2024-03-01?

In the past, I could pass STS using android-sts-12_sts-r25-linux-arm.zip.
At that time, the security patch version of the firmware was 2024-02-01.

Thank you.
Sangmin Choi.

(SW) Kinbay Wu

2024-05-14 10:28

developer   ~0015779

Hi Choi

For the below case, you can try the UI focus on the bottom button (as attached screenshot)
Test : STS
Module : CtsSecurityTestCases

Thank you
Kinbay
image.png (91,762 bytes)   
image.png (91,762 bytes)   

(SW) Kinbay Wu

2024-05-14 11:16

developer   ~0015783

Hi Choi

For the sts tools
As I know the tools are not affected by the security patch

Please check you are flash user debug image to test sts.

Thank you
Kinbay

(ALTech) Sangmin Choi

2024-05-14 14:09

developer   ~0015787

Hello, Kinbay,

For the below case, you can try the UI focus on the bottom button (as attached screenshot)
-> It works, I can get pass report of STS.

Thank you.
Sangmin Choi.

(ALTech) Sangmin Choi

2024-05-16 16:57

developer   ~0015809

Hello, Kinbay,

I attached the Google xTS report which is tested by ALT.
Please review the attached Google xTS report whether there is any issue to get the certification or not.

There is no CTS Verifier report yet.

Thank you.
Sangmin Choi.
15.542.50_tested_by_ALT.zip (41,597,058 bytes)

(ALTech) Sangmin Choi

2024-05-20 09:14

developer   ~0015854

Hello, Kinbay,

Could you please check this comment in this ticket?
https://btracker-cns.fii-foxconn.com/vaas/view.php?id=1938#c15809

Thank you.
Sangmin Choi.

(SW) Kinbay Wu

2024-05-20 09:29

developer   ~0015855

Hi Choi

I have reviewed the reports and found no issues.

Thank you
Kinbay

(ALTech) Sangmin Choi

2024-05-23 15:17

developer   ~0015880

Hello, Kinbay,

Could you please check review the following Smoke Test Report?
https://docs.google.com/spreadsheets/d/1bcExPEK2PqWqWCjVseCuuMm4MVeJUu9i/edit#gid=169765125

Thank you.
Sangmin Choi.

(SW) Kinbay Wu

2024-05-28 13:51

developer   ~0015902

Hi Choi

I have reviewed the report and found no issues.

Thank you
Kinbay

(ALTech) Sangmin Choi

2024-05-28 14:16

developer   ~0015903

Hello, Kinbay,

Thank you for support.

Best Regards,
Sangmin Choi.

(ALTech) Sangmin Choi

2024-06-17 16:22

developer   ~0016057

Hello, Kinbay,

Below item was passed before, but I can't get the pass report now.
Do you have any experience like me? Could you please check your QA engineer?

Test : CTS
Module : CtsHdmiCecHostTestCases
Test Case : android.hdmicec.cts.common.HdmiCecStartupTest

run cts -s SKBFX9C72AF -m CtsHdmiCecHostTestCases -t android.hdmicec.cts.common.HdmiCecStartupTest

Unexpected messages sent by the device
expected to be empty
but was: [0d, 8e]

Thank you.
Sangmin Choi.
2024.06.17_17.18.58.zip (298,649 bytes)

Issue History

Date Modified Username Field Change
2024-05-03 10:21 (ALTech) Sangmin Choi New Issue
2024-05-03 10:21 (ALTech) Sangmin Choi Status new => assigned
2024-05-03 10:21 (ALTech) Sangmin Choi Assigned To => (SW) Kinbay Wu
2024-05-03 10:24 (ALTech) Sangmin Choi Note Added: 0015661
2024-05-03 10:24 (ALTech) Sangmin Choi File Added: gts_WvtsDeviceTestCases_log.zip
2024-05-03 10:24 (ALTech) Sangmin Choi File Added: gts_WvtsDeviceTestCases_result.zip
2024-05-03 10:40 (ALTech) Sangmin Choi Issue Monitored: (SW) Kerwin Chen
2024-05-03 10:40 (ALTech) Sangmin Choi Issue Monitored: (ALTech) Wooshin Kang
2024-05-03 10:40 (ALTech) Sangmin Choi Issue Monitored: (ALTech) Younkwang Jung
2024-05-03 10:40 (ALTech) Sangmin Choi Issue Monitored: (ALTech) JunGyu Kim
2024-05-03 14:19 (ALTech) Sangmin Choi Note Added: 0015675
2024-05-07 08:28 (ALTech) Sangmin Choi Note Added: 0015696
2024-05-07 08:28 (ALTech) Sangmin Choi File Added: tvts_ TvtsYouTubeTS_log.zip
2024-05-07 08:28 (ALTech) Sangmin Choi File Added: tvts_ TvtsYouTubeTS_result.zip
2024-05-07 13:01 (ALTech) Sangmin Choi Note Added: 0015704
2024-05-07 13:01 (ALTech) Sangmin Choi File Added: 스크린샷 2024-05-07 오후 1.59.41.png
2024-05-07 14:08 (ALTech) Sangmin Choi Note Edited: 0015704
2024-05-07 16:20 (ALTech) Sangmin Choi Note Edited: 0015661
2024-05-07 16:20 (ALTech) Sangmin Choi Note Edited: 0015661
2024-05-07 16:20 (ALTech) Sangmin Choi Note Edited: 0015704
2024-05-08 07:47 (ALTech) Sangmin Choi Note Edited: 0015696
2024-05-08 08:14 (ALTech) Sangmin Choi Assigned To (SW) Kinbay Wu => (ALTech) Sangmin Choi
2024-05-08 08:14 (ALTech) Sangmin Choi Status assigned => closed
2024-05-08 08:14 (ALTech) Sangmin Choi Resolution open => fixed
2024-05-13 11:19 (ALTech) Sangmin Choi Assigned To (ALTech) Sangmin Choi => (SW) Kinbay Wu
2024-05-13 11:19 (ALTech) Sangmin Choi Status closed => feedback
2024-05-13 11:19 (ALTech) Sangmin Choi Resolution fixed => reopened
2024-05-13 11:19 (ALTech) Sangmin Choi Due Date => 2024-05-13 18:00
2024-05-13 11:19 (ALTech) Sangmin Choi Note Added: 0015758
2024-05-13 11:24 (ALTech) Sangmin Choi Note Added: 0015759
2024-05-13 11:24 (ALTech) Sangmin Choi File Added: 2024.05.13_10.10.40_result.zip
2024-05-13 11:24 (ALTech) Sangmin Choi File Added: 2024.05.13_10.10.40_log.zip
2024-05-13 11:24 (ALTech) Sangmin Choi Status feedback => assigned
2024-05-14 08:53 (ALTech) Sangmin Choi Note Added: 0015775
2024-05-14 10:28 (SW) Kinbay Wu Note Added: 0015779
2024-05-14 10:28 (SW) Kinbay Wu File Added: image.png
2024-05-14 11:16 (SW) Kinbay Wu Note Added: 0015783
2024-05-14 14:09 (ALTech) Sangmin Choi Note Added: 0015787
2024-05-14 14:09 (ALTech) Sangmin Choi Assigned To (SW) Kinbay Wu => (ALTech) Sangmin Choi
2024-05-14 14:09 (ALTech) Sangmin Choi Status assigned => resolved
2024-05-14 14:09 (ALTech) Sangmin Choi Note Edited: 0015758
2024-05-16 16:54 (ALTech) Sangmin Choi Assigned To (ALTech) Sangmin Choi => (SW) Kinbay Wu
2024-05-16 16:55 (ALTech) Sangmin Choi Status resolved => feedback
2024-05-16 16:57 (ALTech) Sangmin Choi Note Added: 0015809
2024-05-16 16:57 (ALTech) Sangmin Choi File Added: 15.542.50_tested_by_ALT.zip
2024-05-16 16:57 (ALTech) Sangmin Choi Status feedback => assigned
2024-05-20 09:14 (ALTech) Sangmin Choi Note Added: 0015854
2024-05-20 09:29 (SW) Kinbay Wu Note Added: 0015855
2024-05-23 15:17 (ALTech) Sangmin Choi Note Added: 0015880
2024-05-28 13:51 (SW) Kinbay Wu Note Added: 0015902
2024-05-28 14:16 (ALTech) Sangmin Choi Note Added: 0015903
2024-05-28 14:16 (ALTech) Sangmin Choi Assigned To (SW) Kinbay Wu => (ALTech) Sangmin Choi
2024-05-28 14:16 (ALTech) Sangmin Choi Status assigned => closed
2024-06-17 16:15 (ALTech) Sangmin Choi Assigned To (ALTech) Sangmin Choi => (SW) Kinbay Wu
2024-06-17 16:15 (ALTech) Sangmin Choi Status closed => feedback
2024-06-17 16:22 (ALTech) Sangmin Choi Note Added: 0016057
2024-06-17 16:22 (ALTech) Sangmin Choi File Added: 2024.06.17_17.18.58.zip
2024-06-17 16:22 (ALTech) Sangmin Choi Status feedback => assigned
2024-07-05 12:02 (ALTech) Sangmin Choi Assigned To (SW) Kinbay Wu => (ALTech) Sangmin Choi
2024-07-05 12:02 (ALTech) Sangmin Choi Status assigned => closed